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Markov Chain Hidden behind Power Laws Mechanism of Self-organized Criticality 
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To describe and analyze the dynamics of Self-Organized Criticality (SOC) systems, a four- 
state continuous-time Markov model is proposed in this paper. Different to computer simulation 
or numeric experimental approaches commonly employed for explaining the power law in SOC, in 
this paper, based on this Markov model, using E.T.Jayness' Maximum Entropy method, we have 
derived a mathematical proof on the power law distribution for the size of these events. Both this 
Makov model and the mathematical proof on power law present a new angle on the universality 
of power law distributions, they also show that the scale free property exists not necessary only in 
SOC system, but in a class of dynamical systems which can be modelled by the proposed Markov 
model. 

PACS numbers: 05.65+b,02.50.Ga 



I. INTRODUCTION 



As a distinctive signature, power law exists in many 
real- world systems, such as forest fire [H Hi epidemic 
(HQ, avalanche, social wealth distribution Q, blackout 
of power systems QUI, and earthquake § etc. It is also 
given various names in these above areas, for instance, 
"Pareto distribution" , "Zipf 's law" , "scale free distribu- 
tion" , and "fat tails" etc [l(| ■ 

Since the famous work of BTW (Bak-Tang- 
Wiesenfeld) [Tl] [12] , which was mainly on proving that 
Self-Organized Criticality (SOC) was a potential under- 
lying mechanism of any system with the fingerprint of 
power law, there are increasing research efforts on study- 
ing the issue of ubiquitous existence of this scale free 
property in nature. However, most results are obtained 
via comprehensive experiments of computer simulation, 
but the problem why SOC systems and many other sys- 
tems are ruled by power law, is still mathematically un- 
solved. 

In this study, a Continuous-time Hidden Markov model 
is proposed, with which a rigorous proof on the power law 
distribution is derived analytically. This study also pro- 
vides insights into this novel combination of Continuous- 
time Markov model and the Maximum Entropy Principle 
leading to a better understanding on the dynamics 
of these systems with power law signature. 

The rest of this paper is organized as follows, Section 
HI! briefly introduces some background conceptions, and 
also a hidden Markov model is constructed to describe 
the evolution process of SOC. These descriptive equa- 
tions in different states are introduced in Section HTTl The 
proof on power law in SOC systems is given in Section 



TV] simulation results are displayed in Section [V] Fi- 
nally, Section IvTl will give some discussions, conclusions 
and possible future work of this study. 



II. BACKGROUND CONCEPTIONS AND THE 
PROPOSED HIDDEN MARKOV MODEL 



This work is closely related to Self-Organized crit- 
icality and Continuous-time Hidden Markov Chain the- 
ory. A brief introduction to the basic conceptions and 
the proposed model are given here. 



A. Self-organized Criticality 

Self-organized Criticality is a universal property of 
systems far from equilibrium, and it is init ially pr oposed 
by BTW (Bak-Tang-Wiesenfeld) in [HI 0] [H ■ From 
then on it has been widely applied to describe the macro- 
scopic dynamical behavior of an open system near its 
critical point, where the system displays a scale invari- 
ance feature. But different to phase transition process in 
classical physics, at critical point, it is unnecessary for 
the SOC system to tune its parameters to a set of con- 
crete values. And BTW's model demonstrates that the 
observed complexity which is emerged in a robust man- 
ner, does not depend on the finely-tuned details of the 
system, parameters of the model could be changed widely 
without affecting the emergence of critical behavior. 



Continuous-time Hidden Markov Model 
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When observing SOC phenomena in nature, such as 
forest fire, earthquake, and epidemics etc, the most obvi- 
ous characteristics is their unexpected emergence. Hence 



2 



intuitively, their evolution process can be roughly mod- 
elled into two states: hibernating state and active state. 
However, considering the underlying mechanism for the 
stochastic character of SOC, an active state is not suffi- 
cient to describe the complexity of this dynamical prop- 
erty. Thus, the active state is divided into three sub- 
states: self-sustaining state, declining state and autocat- 
alytic state. An intermediate state-self-sustaining state 
is introduced here, because for a continuous-time model, 
the transition interval between declining state and auto- 
catalytic state cannot be infinitesimal. 

Suppose for this four-state state machine, the transi- 
tion rate between state i and state j is is P(E)ij, since 
usually this transition is triggered by events or induced 
by a certain type of conditions, thus this event-triggered 
or condition-induced transition probability can be writ- 
ten as, 



P{E) = P{E ex ) + P(E en \C)P(C) - P(E ex n E en n C) 



[1] 



Where E ex denotes an exogenous event that will trig- 
ger a transition from one state to another, E en denotes 
an endogenous event exists only under a certain condi- 
tion C, and P(E ex ), P(E en ), P{C) are the occurrence 
probabilities of event E exi event E en , condition C, re- 
spectively. 

Assuming these event-triggered and/or condition- 
induced transition probabilities P(E)ij are all statisti- 
cally stable. Mathematically, these processes can be 
modelled as a Continuous-time Markov chain. This four- 
state Markov model can be drawn in Fig.[TJ Its transition 
rates qij are typically described as the ij-th elements of 
the Infinitesimal generator matrix Q. In a infinitesimal 
time interval At, Q can be expressed as 
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where gy is the transition rate between state i and state 
j, qi is the self-transition rate of state i. 

When time approaches infinity, the stationary dis- 
tribution of the markov states ir = (ir K , 7r s , 7r D , 7r A ) can be 
calculated by 



(Q + E) 1 = (7r H ,7r s ,7r D ,7r A ) 



(2) 



Where 



E 




4x4 



e = [1, 1, 1, 1], 7T H + 7T S + 7T D + 7T A = 1. 



[1] In P(E), we only count independent exogenous or endogenous 
events, these events that belong to an event cascade caused by 
E ex and/or E en are not considered. 




FIG. 1: Four States Continuous- Time Hidden Markov Model 
for evolution processes in Self-organized Criticality. 



and 7TH,7rs, 7r D , 7T A denotes the stationary distribution of 
Hibernating state, Self-sustaining state, Declining state, 
and Autocatalytic state, repectively. 



III. THE EVOLUTION EQUATIONS IN 
DIFFERENT STATES 



For a SOC system far from equilibrium, when it is 
approaching its critical point, instead of entering a state 
of phase transition entirely, parts of its unit population 
will evolve into a meta-stable state. 

To demonstrate the evolution process of SOC sys- 
tems, we can analyze its activities in autocatalytic state 
firstly. In an autocatalytic state, as most of these clus- 
tered meta-stable units are in critical state, a small event 
can trigger a large disaster that propagates quickly as 
well as greatly changes the stable-degree distribution of 
these units. 

For an ongoing event in autocatalytic state, let £ = 
% be the unfolding speed at the normal direction ft 
of this event, via a first-ordered linear approximation, 
£ = can ^ e determined in proportion to the diver- 
gence (V • $)of the energy flux $ dissipating across its 
boundary. For instance, in BTW's sandpile model for 
SOC, during an event, these triggered meta-stable units 
will release their energy to these peripheral units, among 
which these meta-stable ones will be triggered to release 
their energy, and these stable one will absorb the en- 
ergy and become unstable. The equations to describe 
the above processes is derived as, 



dt 

V • $ = 



dl 



dl ■ dri = dA 



(3) 



As the total energy flux $ produced by the event is in 
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proportion to its current size A, thus 



da = k2 ■ A 



(4) 



Where YliK (X^t°) represents the accumulated du- 
ration that the event has stayed at the autocatalytic (de- 
clining) state, i (J) represents that how many times that 
the event has visited the autocatalytic (declining) state. 



Where k\ and k 2 denote these linear coefficients, da 
is the differential of area A. The final expression of the 
above equations can be converted to: 



dA 
~dt 



= ki ■ k 2 A = rA(r> 0) 



(5) 



As observed in the above equation, the coefficient r 
stands for the intensity of positive-feedback effect in au- 
tocatalytic state, which is determined by the dependency 
range or correlated degree among the different units in 
the system. 

Accompanying an ongoing event, a similar analysis 
process can also be applied on its declining states, for 
an event cannot trigger these meta-stable units to make 
them release energy all the time, at micro time scale, 
these units at the event's boundary may absorb these 
released energy, making these meta-stable units become 
stable and the possible large event will shrink to a small 
size, this can be seen as an reversible process of the auto- 
catalytic state, similar to the above analysis, we can get 
an equation to describe the declining state, 



dA 
~dt 



vA (r < 0) 



(6) 



Similarly, the coefficient r stands for the intensity of 
negative-feedback effect in declining state, which is also 
determined by the dependency range or correlated degree 
among the different units in the system. 

As in hibernating state there is no event, while in self- 
sustaining state, there is an ongoing event in the system. 
It is obvious that in self-sustaining state, the event's size 
keeps invariant, therefore the evolution time in this state 
can be omitted in our model, since only the declining 
state and the autocatalytic state are essential in deter- 
mining the final size of the event. An evolution equation 
for the size of the event can be proposed as follows: 



dX{t) 
dt 



= [r • 6(S t -S A ) + r 



S(S t - S D )]X(t) 
t = : X = X . (7) 



In Eqn.Q, X(t) is the size of the event at time t, S de- 
notes Dirac function, St means the system's state at time 
t, S A (S D ) denotes the system's autocatalytic (declin- 
ing) state at time t; r (r) corresponds to the expanding 
(shrinking) speed of meta-stable units in an autocatalytic 
(declining) state. 

According to Eqn.0 above, an event's final size can 
be expressed as 



IV. SOC AS A STATIONARY PROCESS IN THE 
VIEW OF THE LAW OF LARGE NUMBERS 

A. Stable Interaction Hypothesis 

In SOC process, such as forest-fire model and BTWs 
sandpile model, let S s (t),S a (t) and Sd{t) denote as the 
"negative entropy" ^ stored in system, absorbed from the 
surrounding environment, and dissipated into the envi- 
ronment, respectively. Via the laws of conservation, there 
exists the following relation, 



S d (t) =S a (t) ~S s (t) 



(9) 



Which means in a short term, <S<j(t) is temporally deter- 
mined by S a (t) and S s (t). 

However, in the long term, given the system's environ- 
ments keep stable, i.e., S a (t) and Sd(t) are all stationary 
processes, as for any SOC system under study, the nega- 
tive entropy stored in it S s (t) can be deemed as a finite 
quantity. Thus when time goes infinity, 



^ j; o S a (r)dr = ^ j; o S d (T)dT 

(t-t )->oo t — t() (t-to)^oo t ~ to 



(10) 

which means in long term, the entropy absorbed from 
the environment and dissipated into it can be deemed as 
equal. 

For these processes with property of statistical sta- 
tionary, determined by Eqn.@and Eqn. (|10p . the aver- 
age quantity of negative entropy exchanged between the 
system and its environment AS ea: keeps at an invariant 
level. Given any length- fixed time window [ti,t± + AT], 
the number of events rii within it may fluctuate from 
time to time. But in a long term, for n times of observa- 
tions, according to the law of large numbers, the average 
number of observable events n = — — - within this time 

n 

window AT can be regarded invariant, therefore the av- 
erage time interval between events To = 4? should also 
be an invariant quantity. 

As shown in above sections, SOC process has been 
modelled by a continuous-time Hidden Markov Chain. 
During an event, the average time in its autocatalytic 
state (declining state) is 7r A T (7r D T ), and from the prop- 
erties of continuous-time Hidden Markov model, obvi- 
ously, T , 7r A and 7r D are all invariant quantities. 



(8) 



[2] The "negative entropy" here can be denned in a general way, 
including mass M, entropy S, information /, energy E and other 
combinational forms of them. 
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B. Proof of Power Law Distribution in SOC 

Suppose x m denote the minimum size of an observ- 
able event in the SOC system under study, for instance, in 
BTW's sandpile model, x m might represent a sand grain, 
and in forest fire model, x m might represent a tree. As- 
suming that all the observable events in the system have 
the same initial S1ZG Xffi ■ by the solution of Eqn.©, it 

is obvious that only when (r-7r A + r7r D ) > 0, the event is 
observable. 

During its evolution process, assuming N events with 
different size JQ (Xj > x m ,i — 1, ■•■ , A) can be ob- 
served in the SOC system. Suppose they are ruled by a 
distribution f(x), to histogram them into a double log- 
arithm coordinates via their sizes, these events can be 
quantized into m different sets or intervals, for instance, 
in set I (I e {!,-■■ , m}), there are N t (YT=i N i = N ) 
events, and in this set, the size difference between event 
Xf and event Xf should be less than Sx, ■ Here Sx, is 
the threshold value for set I, ensuring in it Yiflii-^i) ^ s 
almost equal to (X/ 



Let define quantity L as 



N 



A', 



1=1 



Based on Eqn.flSJ), L can be expressed as, 



(11) 



(12) 



In Ean.([T2]). tf { (t° J means the duration that the 
system stays at the autocatalytic (declining) state in the 
event i of set I. 

Let define quantity -0 as 



/ def InL v(+ t * +?t D 



It can also be expressed as 



if, 



N 



N 



As 



A/ 

lim -rf - f(X t ) 
s x _o iV 



(13) 



(14) 



(15) 



as f(x) denotes as the events' probability density func- 
tion. Eqn. (|14| can be expressed as 



f(x)lnx dx 



(16) 



therefore ip is equal to the expectation of Inx, as the 
stationary distribution of this continuous-time Markov 
chain is n = (ir H , tt s , 7r D , 7r A ), and also because 

ip = E{lnx} = ln(x m ) + (r ■ tt a + r ■ tt d ) • T (17) 



as this SOC process has been assumed as a statistical 

stationary process, x m , r, r, 7r D , 7r A and T are all con- 
stants, ip can be deemed as an invariant quantity. 
The entropy of the system can be expressed as 



J(f) 



f(x)lnf(x) dx 



(18) 



according to Eqn. (|17p and normalization condition, via 
lagrangian multiplier method, the above equation can be 
converted in the following form: 



./(./) / f{x)lnf{x)dx + \ l {J f{x)dx-l) 

+A 2 ( / f{x)lnxdx-xj}) (19) 



By E.T.Jaynes' Maximum Entropy Principle [161 ]. we 
can get 



f(x) = e Xl x X2 

let a = — (A 2 + 1), we can get 

f{x) = ax^x-*- 1 (a > 0) 

As 



(20) 



(21) 



f°° 1 
E{lnx} = / ax'^ l x~ a ~ 1 lnx dx — lnx m H — (22) 

Jx m a 

from Eqn.(fT7| and Eqn. ([22| . 

a = [(rTTA + rTTc)^]- 1 (23) 

V. SIMULATION RESULTS 

Since the average periodicity or interval To be- 
tween events is a constant quantity, and the distribution 
for the holding times of this four-state Markov model 
{■701, 7T£), 7i7j, tts} is stationary, using the discrete time 
method introduced in fl7j |. we get different power law 

distribution by simulation at different parameters r, as 
shown in Fig. O 

VI. CONCLUSION AND FUTURE WORK 

The SOC system under study and the environments 
are all supposed to be statistically stationary, this can 
be correct for almost all cases in real-world and artificial 
systems. Though observed in a short term, these param- 
eters, like transition rates, are usually not as static as we 
expected, which means flux of energy, mass, information 
and their combinational forms are not constant quanti- 
ties, the frequency of event will fluctuate in this short 
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FIG. 2: Power Law distributions with different simulation pa- 
rameters, where r± is equal to r noted in the above sections. 



22] [23] etc, but as our model has different features from 
HOT, a lot of research studies are still very necessary at 
this direction. 



APPENDIX A: LIFE TIME OF AN EVENT AND 
ITS MULTI-TIME SCALE PROPERTY 

When the state of a SOC system is in its hibernat- 
ing state, there is no event in the system, otherwise when 
an event happens, by passing through the self-sustaining 
state, the system will escape its hibernating state into 
any one of these three active states - self-sustaining, 
declining and autocatalytic states. If the event keeps 
on, the system state will jump among the active states 



term. 

This continuous-time Hidden Markov Model can give 
us a framework to describe the dynamical properties not 
only for these SOC systems, but for these regular systems 
different to SOC, yet owning positive and/or negative 
feed-back states during their evolution processes. The 
ubiquity of power laws is mainly because the ubiquity 
of these systems that can be described by this Markov 
model. 

One potential direction based on this model is to unify 
these stochastic processes with power law fingerprint, 
such as Geometric Brownian motion, Discrete multiplica- 
tive process, Homogeneous birth-and-death process, and 
Galton- Walton branching process etc in [18[ , Forrest-fire 
model in [jjjj . and Yule process in [2(| etc. 

As human behavior can affect the bidirectional flux 
between the systems and its environments, there is pos- 
sibility on controlling the events frequency and their size 
distribution, so as to reduce the probability of large scale 
events and prevent the collapse of the whole systems. 
Some applications and academic work based on Highly 
Optimized Tolerance (HOT) have been done in Q 3 HH 



FIG. 3: Continuous-time Markov chain demonstrated along 
time axis t. 



stochastically. Therefore in this Markov model, the life- 
time of an event is the duration since its last escape from 
the hibernating state until the next return to it. 

The multi-time scale property of this continuous- 
time Markov Chain model is displayed in the follow- 
ing Figj3l where A(D,S,H) stands for the four states of 
the Markov model respectively. The framed section is 
zoomed out to show the detail information of this Multi- 
time scale model. 
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